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<J-> ^)Vmc «fc D * aU-Uff^ri'^y ©2^13? 
CPUfOMIgl^ffflL, M»EJftf1«frS<D3V 

C C D«*ffifflU l9CF7-r/^gb^60lWISK:«t 
JBBOB#7 , -**7*^*;l/-r-*fc*»L, Bit 10 

Magp\a^ f s H{iA*# a t , 

ASICfOA-hW, MfECPU^H£fflL/cV 
yh^mmmmiHO, MsBBfiA^Sfr SA^ti 
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Ko 
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MfB^»ffi$g©SS^ffl^n k-ftffcDff fS^MK F5 
MIB/ ^ - y v y ^ y FWl frb ©'If $ g s M SB 3 v y 
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BftMSKo 
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fet), A^*nfc^x-^/b^*nTV^#3vy 
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ff©3Yy FOA^&fr? C P U^O© 

SSS^ffiffl U MfBSflF¥ &fr £ €» n V y F K <fc <3 ■ 

o h'y^mmt, CCDf^fflU iEF7^;^ 
gfrP,<D|ij»lc <fc MfflOH«7*-^*r S^rt/x- 
*£gglU H««Laa5^til*-rSB#A^¥Si:, A 
S I C^(D^-F|1]SS^ MIBCPUf«ffifflLfcV7 
hW*«La^fc«fct), MfBBfiA^g^A^na 
f^y £ ;Hifi -r- £ MfB F 7 ■> 5 dHfiffi 

%ff 3 BiM^g fc, MfBBftMMc <fc t) *SJIff 
SftfcH«r-*£, L — if 7°U y^^y ^Av F 

7u y *4?o 7°y y * tc j: o Tta**fr a Blimps 

T$oT, c <DSKHi7^7 yW^-^^H,^- 
SfcteffiiH&fHMaSPKffiffl £tiTi^MfBt«H^ yf- 



^PXtJ^m t , MiB^A* 6 ©§ 
fst-#£A*U Stf-^'NOtg^f^O;^- 

yv-yfy^ av>KA ©gffc^fcff 5 

io [0 0 12] (2) M!B^^li¥©a, MfB^A^ 

Atj^It? i»ft$ft$HA;fr¥&J;, M!B»ff¥®gfSfiiS 
^MIB^x-^^fJS^T, ^n-FtV 

f-y^TV\ &nvy F tM-f S»<ttS *tttfrr«/< 

20 t-li#©'»$g%MIBF^^^#IS^e»A±)^fT5 

<&m.l, MIBnvy F'lf «A*¥a<D« «4:*Stt 
Ts Jfi«3 t!~o*a-(i N A^?n/cMlB^3vyF 

McS§aYyFjjiifgi; % MIB3vyF®a# 
g«p 5 © n v y F 'Iff W% n tf - o« £14 F 5 -Y ^ 

Sfc, «fcD^5ci:*!|tStfc-rs^« (l) K«<D*j3 

3-T>FisiiBfi®aSBo 
so [0013] o) m&p^yvwmmmtm. 

*MHfc-r*waci), (2) <D^-rn^tB*©^3 
^yYwmm\mmmm.o 

[0014] c 4 ) wmnp^y Ywmm\mwm 

it. ME^^x~^*SS-rsiSK, MfBS¥»r-^« 

ttzmm en , (2) , (3) ©^-rn^tB«©^ 

40 ^yy F I^Bfi^aSfio 
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Ho 
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(4, MIB^^(cj;0^^tT9^^ ^©^ATjStl 
ft3-7yK«On7V F^afttLTV^fcif^ 
so B©a7yF»U ffiffl#fcSK*ffi-rci:*ffa 



5 

t-tzmm (i) &^b (5) ov^ftjwEtfosjfra 

[0 0 17] 
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[0 0 18] 2) Sfc, r-^SS^fTaiSfcfe, 
-y^yf-y^fiv, KBS03v>KkRii;3v> 
F£A?Jb/cB=H\ ilfKLfcnvyF, SMttb;fcSJ*W 

ffifcrr*cfcf«:«fc!K SlLi^tfenvyF^ IE 
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vmwmzm i ii^scdw^^ti^ 
f § c ei it, *n i n»j ©«^«<o«fig 7- d v ? m 
%m (Hi ^ «iirr*»2~»5iisseitt,«ffl-r 

[0 0 2 2] 10 1 {itSf^ap?, 0 8 

[0 0 2 3] 1 0 2ttK5-r^»^ CPUlO»l8 
B^Hgfflb, KftSU 0 l^Boa^FfcioT, B 

g|51 0 3, HfiMSgPl 0 4, 7°U>^gPl 0 5m(DW] 

[0 0 2 4] 1 0 3fiH«A*SP^ CCDfffl 
b, F^^^SPl 0 2^5,©$iJfPt cfc^T, fCfS^Bft 
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x— ^fv'^P t — £ f b , BfiMSSPl 0 4"\ 
[0 0 2 5] 104 «Bft®fflgPT\ A S I CfOA- 

Fmsg^, c p u ffl l fc y 7 h iif sa o 

T, Bft A 1 0 3 h Kh * tiT < § r 5>*/lM 
-r-**, F^-T^gPl 0 2^5>©Bft®ffl(D^tjS 

[0 0 2 6] 105 tiBff fcHrtSP-^ HttSMi: 1 0 4 

[0 0 2 7] 1 0 6l±^A*SPTfs V-f^P^y^ 
ffifflb, ^©AT^fiV, rv'^/l/f - £ £ btfp 

[0028] 107 tt^snap-e, ^Xh% 1 0 6 

20 fr^^x-^ATjU ^•x-^^OSil- 5 ?'^ 
«E, 0 2^\i:ai6nSo 

[0029] *ic, *»nofifttTfts#ram i o 

[0 0 3 0] 20ia^r-^AMT, COS^A 
AfgP2 0 1 frt><D7 t i?*fr : gp7 i -$*XtJ?%o 
30 [0 0 3 1 ] 2 0 2 fiSlftSl51SffiA*gp-e, 1 0 

l 5 A73 S ti/c n t y F 'Iff go At: *ff 5 . 
[0 0 3 2] 2 0 3 t±S¥»x-^««gPT\ 

^©iB'ii«wce»bT^<o 

[0 0 3 3] 2 0 4{4^-yv«yf-y^»-e, 
-^A*gP2 0 lfr6<0f-^fc, S*»7*-**«g|5 2 
0 3^6cD^i»*x-^ t<D/Vn—>W?-yir%fT 

i\ &a-?y¥ictt~?z,m{m%mj]t%o 
[0034] m*.&. Atj snftf^f- r^-g 

©MKSii 10 0, ^^J tolSiKSfi 8 0, 

«5, &Hfcffi**ff3o 

[0 0 3 5] 2 0 5 (i F7 -Y^1f fgA^SPl?, S#tffg 

©sit^a^n if-iifM5©ma* / 1 o 2 ^ 

[0 0 3 6] 2 0 6{43T>F«yi«^ ;^-^V-y 
f-y^mi 0 4^P,©'|ftg^nv>F'lftSA7jg|5 2 0 5 

50 ^n^> f ^v-rnonv y Ftffls-r § ^wif b, 



gP2 o 7 im%m(Dmm*fi 5. 

[0 0 3 7] 2 0 7»3 , 7>FUi** , P, a^y^mm 

i o 2 ^jiftgp i o i FS^gi^wt 

•s^^-rsfB^aft^i o 
[0038] ^fcn#waffii**»fT«yirts*Biwr 

AXjgfl2 0 2fr5tt, *©B##3ttT^S*-©1il«tf 
AX7£tl£ 0 

[0 0 3 9] M*.i£* raa 3 i ftj fj 5 rjk 

8jS"fSo tSt Mtftffil 0 1*&F7^/^1 02 

mm i o 7 ©»ftgPffifgA^a5 2 o 2 Kt, uta? 

[0 0 4 0] 3;fc, 0 6*60*^7*-* 

W\ *?*rr-*Art»2 0 1 tcA^^K 3vyFW« 
fcttfcSf*-r-**«a5 2 0 3^AX72ti3o 
**j»fi|5 2 0 3T*fcl\ rntf-j fci^SnTj/KfdtfJS 
IT, A^*tlfc^f : '-^%IBMtT*3< 0 

[0 0 4 1] IxT, ratttc ranj ^anvyKtf 

[0 0 4 2] x^-h^WLWa, rx?-Fj 

[0 0 4 3] W±OfflifCj; ?K SBHcntr-SffV^a: 
#5 rnk-j , rfinj , rittj, rx?-hj i; 

[0 0 4 4] &&<rmi*^y\i£Sffi<DWiftS'-*y 

fSa-r^c §j£AX7 (Xf-y^S 3 0 1) H2(Df 
j*7*-*Art»2 0 1 T'fiV, *<DR$<E>l*ftSI$©tt&l* 
»ft8Ptfi5ZAX795 2 0 2fftSiU *-A*tfRHSKfT 
frftTl^frSfrOW&fr 5 (Xf-y^S 3 0 2) 0 
[0 0 4 5] *-A#tfHBf fcfffcttTl^S*^ fp 
7*-*SSF&-F (Xry/S 3 0 3) £&3 0 t\&- 

(Xf^S 3 0 4) s WHavyW 
(Xxy7°S3 0 5) ttt, AX/^tl/fc^ 
Ft LTSf f-^SiSS 2 0 3 
ML (Xf7/S 3 0 6) s ^nvyF^iff Uf 
>y7°S 3 0 7) t^o 

[0 0 4 6] J^±©#Xx^7°t^t§N0^ 
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"T ~>-7 y X^i^p?^ t§Xr>y 7°© ^PIfflS£BJ3 
[0 0 4 7] U±0*ffiKJ:oTSES*nfc3vyF 

[00 4 8] SJlntf-^lftJfD/cWl^ 

mj tmpt%ztic£-DT ram Ft&So * 
oft. riftj, rx^-Fj tiptsotiao 

[0 0 4 9] L©|Of^37y FUffH^Oljftv'-r 
CiStS. W^ATJ (Xr'y/S 4 0 1) fc0 2<E>§ 

^x-5A^gP2 0 1 T?fTi\ ^wmmfu 1 0 1 O 

tfffi*i*ftg|5tfiHA7j8fl2 0 2t?^nU *-AXJ#|fO 
BfWTt>tlTl^^5^©|iJKT^ff5 (Xx-y7S 4 0 

2) o 

[0 0 5 0] ^-A7W^imcfTbtlT^%!/^Il^ § 
J*r-**fr*-K (Xfy7S 4 0 3) t&3 0 
20 -y^fy^2 0 4tcj;oTt^f-^©;^-y 
Ty^-y^SfTV (Xt7^S 4 0 4) , S»*nTV 
§n?y KfcMKLfcfcOtf 1 o/St&o (Xf 
>y7°S 4 0 5 • S 4 0 6) fctt, W£ft1t ! 8p7 t -# 
*3vyKkLT*ff (Xf77*S 4 0 7) t3o 
[0051] c©fc#©£j*3v:/F0B»c:ov»T* 
#»W§:f^YyFOlI(i, H2 0t?f 
-*A7Jg!5 2 0 lfr&©S*x-*fc, 8f»7*-**» 

/<*->Ty^>^»2 0 4fCj:oTffV\ * 

30 3-ryFi:o«ftie*»Hib3T^Fj![iaai52 0 6cm 
atTwft^, itffig^ 1 0 0 tt5o 

[0 0 5 2] raMj tl^o/c^x-^AXl 

x-#<d renj fctt-aft^9 5, rntf-j ^cd- 
as«5, rifo^cD-Miio, rxx-H k 
©-Sfitt 5, ftt*fci^Wa?y FSasaP2 0 

[0 0 5 3] nT>F®fflg|5 2 0 6t1t gfe-SfS© 
40 ft^fetD^^AXj^n/cnvyFtliJilfLT, nv>- 
FW*»2 0 i\m%o 

[0 0 5 4] 3V>FlUAS2 0 77li, JfOavvK 
*F7^»1 0 2K3S5Ci:lc«t^T, 

[0 0 5 5] ±fE2 0cDS!)fF7n-H3, 4cDffl*-&^ 
50 ^HYyF^litSo 
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[o o 5 6] riftj , rx^-F-j mpt% 

[0 0 5 7] J^±©<fc5fc#^nvyF©T-£A?j£ 
ft5z.£lc£.iX, iSSnvyFi iftg&fmcgft 

[0058] ^mmm^p^y^mftm^m 
[0059] (jg 2 (ommm) ^mmm^> m z omm 

M*. WPflBK H2*«fflLTKWr* : t>u 
F 4: LTfiSSnT^4^37> Ftf A7J2 

[0 0 6 0] $f\ S?3?yHttHl, 2fc*»t«i» 

ft 815 i o i o^-h 8 tfws n4v>tt!B"eA*sn* c 

[0 0 6 1] H2KfeW-S^-T'y^-y^fl|J2 

y^v^y?-*.ft\\ *3v>Fk <oiff«jS %naj 1 3 

FJHiaJ 2 0 6 fcSSSo 
[0 0 6 2] li?ftW§3vyK}:til 

V^i§£\ llfttg^ lOOt LfcW^K, 8 O&Lhfcn 
•^FOfgffi, 8 0*»ttSS«ftT^3WKO 
AAfcfflWfSfc, ^X<D^yf-y^ftiTcm^ 3 

[0 0 6 3] ^<D£Wf^ 3YyFM^C<t^T 

U 3v;/Ktftfj»2 0 7fr5, JSfNfli o lcD^Hi! 

oa^fcfj 3 c £ o t, mmicmyt % x 5 k f 

[0 0 6 4] *aST?fe«Ci:*«tBLfc 

[oo6 5] &,±<D^m2mmmco^pmm(om^y 

-^ryX73-ft-hii, 0 5 <Di/—>T y7M&&& 
^KiS^t^o h^ATI (Xr-^S5 0 1) 

omp?-* \-h%2 o i xftw ^(omvmwn i o 
i ©tt«i**ffa£KMx*a5 2 o 2 tmiu +-A71 
WTt> nT ^ § fr&fr mm*ft a ( x f y 7° s 

5 0 2) o 

[0 0 6 6] *-A#:bW£fTfrnT^fcV^§£\ § 
^f-^Ufft-K (Xx<y 7°S 5 0 3) fcftSo ^ 



W?-y?1tft^ Ut7 7°S 5 0 4), llfHnvy F 
/b^^fcif^- (Xx>y7°S 5 0 6) fctiu 3Y>Ftf 
*SST-S § C tttimmic* y -b-^fc 1 
OlfrSS^L (Xf77S 5 0 6) , ^^tf^-ATJ 

S 5 0 7) „ *nfc«t3V^F**fr1-S (XfyT" 
S 5 0 8) 0 

[0 0 6 7] W±o«t5f<:, f^yFOf-^AA 

4vwh timpxti s ntz t % \z mm Km fc % n v 

[0 0 6 8] *<g2*»JO^:3vyF§SBt0 5© 

#x r *y 7° t fett § * y x H£0i «-x f 

[0 0 6 9] (m 3 <OHj6fi0!l) ©tg 3 ©StfS 

^ywmfttft^mSs mcmszti-z^zu^y 

[0 0 7 0] f?37V K3W*ff» 1 0 1 (D*- 

[0 0 7 1 ] 0 4E*o 

a«P2 o 6 (c^5 0 

[0 0 7 2] KESSSnT^5D7yK-e 

[0 0 7 3] nT>KtH*gP2 0 7^ 

6, liffgP 1 0 1 £D?« B B H g^ (0 8) SfKa<Dflf 

^fta^^ K*aa?r § c t k x i fl>^#icflie 
[o o 7 4] mmzmifzt, n«j tv^nvy 

FW:Sl?nTi/^};:fcmP>f, HtfSSLJ; 

5fcbfc«^ ^ffl#ttift^S|51 0 IO*- (08) % 
40 [0 0 7 5] MI2H 1 O^S6ifl»Jfcfe^TiKWLfe^ t 

rnmic ^jswmi o 7 laot/^-yv^^ 
*fjv\ mm&vnmftot, rifci tv^avy 

F OMftUt ^ 9 0 4 0 , 8 0K_h^3Y y F ©MS, 

a, ^na-r^Kgg^txTi^nvyF tfuw^ti 

[0 0 7 6] CO«t3ft»^ H9fc*<0-«!l*S-rJ: 
■5{cSb b h^ (0 8) oa^apfc r^onvy 

Ktt riftj T~T^?J tl/^dS^i: TY E Sj , TN 
so Oj OSW*ff5^fc*ffv\ f£ffl#tsatr^Ox 
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[0077] ry E SJ <D*— cfcti^r, ft 

K^/TOl 0 2«, WlSnft37>K*»Wtf 
T, ^-O&Oi&JIfcfr? Ci; ffSo TNOJ 

[0 0 7 8] fiLhfO»ffi/-5r^7n-ft-Ki, 

(Xf«v7"S 6 0 1) *^f*-^X*SP2 0 1 T?ff 

mmttfto (xf7 7"s 6 o 2) „ 

[0 0 7 9] *-A##rai$fcfibftTV'»S»£, 
f-^Ig^-K (Xf-^S 6 0 3) k&So 

v=f-y?mi^ (Xr-^S 6 0 4) , «nv>K^ 
Sofc^# (Xf77"S 6 0 5) (ctts nvyWH 
tztitmmic* y-fe-^^LTSf^gpi o 

lfrS^L (Xf ^7°S 6 0 6), ^©tS: TYE Sj © 
(XT7 7S6 0 7) , 37>K4 
SfrtS (Xf'^S 6 0 8) o 

[0 0 8 0] &±<D£5ic, i^nvyFOf-^i 
£fT9 C tic i^T N ■$-T?KSflh*flTV« 37>K* 

[0 0 8 1] &fc\ :^3£Mffil©£j»n'7>KB®8 
©06§Xr >y 7°tcfcnt§ ^-^r>X^S^en^1-# 

[0 0 8 2] (f|4©|«J) ^(C*^{C^S^4© 
SSOnv;/ K*gSL«fc5 tLfti^ BEfcggteft 

[0 0 8 3] £1\ y KfcWNfl 1 0 1 <d*~ 

[0 0 8 4] ;V-VV7f^2 0 4li:A5 

JISP2 0 6fCg3 0 
[0 0 8 5] d©i§£\ KKSi|^tlT^§nv>F 

Ktitfj» 2 0 7^6, J*fN95 1 0 1 Offift^SP 
(0 8) fc, aflaSOK^ofenvyKSS^-rsci: 
fc<fc^Tfl!ffl#t»B*ffi , t<I:5Ex K5-T^»l 0 2 

[0 0 8 6] lWJ§W§fc, T8ftj fc^5 37> 

1©*- (0 8) fcffbfttfB T8fej L 



[0087] msm i (Dmmmic^-zmmLrcmit 
mm:, gjsmm 1 o 7 c±oT/^-^?-yf^ 

F (Dmim 8 5 i: * D , 8 0 JK±£ 3i v y F ©« 
8 0*P«SS^nTi/^t/>3ivyF©AX7^WiTl-§ 

[0 0 8 8] d©^, ?Of^t<i;§37yFA* 

[0 0 8 9] CO«k5a»-&, 110«£D-i^t 
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(54) [Title of the Invention] Voice Command 
Recognition and Image Processing Apparatus 

10 

(57) [Abstract] 
[Problem to be Solved] 

In a multifunction peripheral including a copying 
machine, a facsimile, a printer and the like, which 
15 recognizes a command inputted by voice and operates, if 
an unspecified large number of people use the 
multifunction peripheral, means for mitigating 
excessive capacity of a storage medium such as a memory 
for voice dictionary data to be previously registered 
20 is provided. 
[Solution] 

Consequently, a configuration has been provided in 
which, when reference data is registered in the 
dictionary data, the registration is performed while a 
25 button or the like at an operating unit 101 is actually 
depressed so that an operation can be performed only by 
the voice when the same command is used next time, and 
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moreover, also when the registration is performed, 
pattern matching is performed, and a user thereof is 
warned if a command which is the same as or similar to 
a command which has already been registered or a 
5 similar voice has been inputted, and also, moreover, 
data having a high degree of similarity is more 
correctly recognized according to another determination 
factor such as fingerprints or palm prints. 

10 [Claims for the Patent] 
[Claim 1] 

A voice command recognition and image processing 
apparatus characterized in that said voice command 
recognition and image processing apparatus is composed 
15 of: 

operating means for inputting a command for a copy 
operation, a facsimile transmission or the like through 
a switch, a button, a numeric keypad, a liquid crystal 
touch panel or the like; 

2 0 driver means for using a processing device such as 

a CPU, performing setting of image processing or 
setting of the number of sheets to be printed and the 
like according to the command from said operating means, 
and controlling operations in image input means, image 

25 processing means, image output means and the like; 

said image input means for using a CCD and the 
like, converting image data on a manuscript into 

- 2 - 
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digital data under the control of said driver means, 
and outputting the digital data to said image 
processing unit; 

said image processing means for processing the 
5 digital image data inputted from said image input means, 
depending on the setting of the image processing from 
said driver means, through a software-wise process and 
the like using a hardware circuit such as an ASIC, said 
CPU and the like, and performing output to said image 

10 output means; 

said image output means for outputting the image 
data processed by said image processing means at a 
printer such as a laser printer or an ink jet printer, 
this part also including means for performing display 

15 on a CRT monitor, a liquid crystal monitor, or said 

liquid crystal touch panel used by said operating means 
unit, outputting the image data onto a network, or 
performing the facsimile transmission or the like via a 
modem; voice input means for inputting voice by using a 

2 0 microphone and the like and transmitting the voice as 
said digital data to voice recognition means; and said 
voice recognition means for inputting the voice data 
from said voice input means and performing registration 
in dictionary data, pattern matching of the voice, 

25 conversion into the command and the like, 
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and said voice command recognition and image 
processing apparatus performs recognition of the 
command according to said voice and operates . 
[Claim 2] 

5 The voice command recognition and image processing 

apparatus according to claim 1, characterized in that 
said voice recognition means consists of: 

voice data input means for inputting the digital 
voice data from said voice input means; 
10 operating unit information input means for 

inputting command information inputted from said 
operating means; 

dictionary data accumulation means for associating 
said operating means unit information with said voice 
15 data and storing them in a storage medium such as a 
memory or a hard disk; 

pattern matching means for performing the pattern 
matching between the data from said voice data input 
means and voice dictionary data from said dictionary 
20 data accumulation means, and outputting a degree of 
similarity with respect to each command; 

driver information input means for inputting 
information on the registration of said dictionary 
information or a normal copy operation from said driver 
25 means; 

command processing means for receiving information 
from said pattern matching means and the information 
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from said command information input means, and in the 
case of the normal copy, determining which command said 
inputted voice command corresponds to, and transmitting 
the determination to command output means; and 
5 said command output means for transmitting the 

command information from said command processing means 
to said driver means or a mode display portion of said 
operation means in the case of the normal copy. 
[Claim 3] 

10 The voice command recognition and image processing 

apparatus according to any of claims 1 and 2 , 
characterized in that when the data is registered in 
said dictionary data accumulation means, said voice 
command recognition and image processing apparatus 

15 registers said voice data while actually performing an 
operation. 
[Claim 4] 

The voice command recognition and image processing 
apparatus according to any of claims 1, 2 and 3, 

20 characterized in that when said voice data is 

registered, if the same data as data which has already 
been registered in the data in said dictionary data 
accumulation means has been attempted to be registered, 
said voice command recognition and image processing 

25 apparatus informs a user of it. 
[Claim 5] 
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The voice command recognition and image processing 
apparatus according to any of claims 1 to 4, 
characterized in that when the setting is performed by 
said voice, if a non-registered command has been 
5 attempted to be set by said voice, said voice command 
recognition and image processing apparatus informs the 
user that the command is non-registered. 
[Claim 6] 

The voice command recognition and image processing 
10 apparatus according to any of claims 1 to 5, 

characterized in that when the setting is performed by 
said voice, if the command inputted by the voice has 
been similar to multiple commands, said voice command 
recognition and image processing apparatus informs 
15 those commands to prompt the user to select among them. 
[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

The present invention relates to a multifunction 
20 peripheral including a copying machine, a facsimile, a 
printer and the like, and particularly to this kind of 
multifunction peripheral using voice in a user 
interface for inputting a command. 
[0002] 

25 [Conventional Art] 

In recent years, as seen in personal computers, 
car navigations and the like, apparatuses which input 
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commands by using voice recognition have become widely 
used. However, there has been no conventional 
multifunction peripheral including a copying machine, a 
facsimile, a printer and the like, which has the above 
5 described function. 
[0003] 

In order to perform this kind of voice recognition, 
"pattern matching" of vocal prints, separations of 
voices, sound pitches and the like is performed. This 

10 pattern matching is a kind of matching in which a 

command used for a storage medium such as a memory and 
voice data at the time of speaking the command have 
been previously associated with each other one on one 
and registered as a dictionary, and how much an 

15 inputted voice data matches each registered command is 
calculated as a degree of similarity, and a command 
having a maximum value thereof is selected as the 
command and is executed. 
[0004] 

20 [Problems to be Solved by the Invention] 

However, in the above described multifunction 
peripheral including the copying machine, the facsimile, 
the printer and the like, when the commands are 
inputted by the voice recognition as described above, 

25 there are problems as described below. 
[0005] 
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In other words, when the commands are inputted by 
the voice recognition, it is necessary to previously 
register all commands to be used in the dictionary. In 
a current command registration method, all commands to 
5 be used have had to be associated with respective key 
operations and registered while being read once. 
[0006] 

As in the conventional apparatus, in the car 
navigations, the personal computers and the like in 
10 which users are limited to some extent, data to be 

registered is generally personal data, and it has been 
necessary to input only the voice data on one person. 
[0007] 

However, in the case of a machine used by an 
15 unspecified large number of people, such as the copying 
machine, it is necessary to previously register voice 
dictionary data on many people who may use the machine, 
and also capacity of the storage medium such as the 
memory used for storing the data is required to be 
20 reasonably large. 
[0008] 

Moreover, frequency of usage of the command which 
has been registered varies among individuals. It is 
necessary to previously register all commands also 
25 including a command which is eventually not used at all 
by certain people, which results in unnecessary use of 
the capacity of the storage medium. 
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[0009] 

The present invention has been made in view of the 
above described situations, and it is an object of the 
present invention to provide a voice command 
5 recognition and image processing apparatus which can 
solve these problems . 
[0010] 

[Means for Solving the Problems] 

Consequently, in the present invention, a voice 
10 command recognition and image processing apparatus as 
shown in any of the following respective items (1) to 
(6) is provided to achieve the above described object. 
[0011] 

(1) A voice command recognition and image 
15 processing apparatus characterized in that the voice 
command recognition and image processing apparatus is 
composed of operating means for inputting a command for 
a copy operation, a facsimile transmission or the like 
through a switch, a button, a numeric keypad, a liquid 
2 0 crystal touch panel or the like; driver means for using 
a processing device such as a CPU, performing setting 
of image processing or setting of the number of sheets 
to be printed and the like according to the command 
from the above described operating means, and 
25 controlling operations in image input means, image 

processing means, image output means and the like; the 
image input means for using a CCD and the like, 
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converting image data on a manuscript into digital data 
under the control of the above described driver means, 
and outputting the digital data to the image processing 
unit; the image processing means for processing the 
5 digital image data inputted from the above described 
image input means, depending on the setting of the 
image processing from the above described driver means, 
through a software -wise process and the like using a 
hardware circuit such as an ASIC, the above described 

10 CPU and the like, and performing output to the above 
described image output means; the image output means 
for outputting the image data processed by the above 
described image processing means at a printer such as a 
laser printer or an ink jet printer, this part also 

15 including means for performing display on a CRT monitor, 
a liquid crystal monitor, or the above described liquid 
crystal touch panel used by the above described 
operating means unit, outputting the image data onto a 
network, or performing the facsimile transmission or 

20 the like via a modem; voice input means for inputting 
voice by using a microphone and the like and 
transmitting the voice as the above described digital 
data to voice recognition means; and the voice 
recognition means for inputting the voice data from the 

25 above described voice input means and performing 

registration in dictionary data, pattern matching of 
the voice, conversion into the command and the like, 
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and the voice command recognition and image processing 
apparatus performs recognition of the command according 
to the above described voice and operates . 
[0012] 

5 (2) The voice command recognition and image 

processing apparatus according to the above item (1) , 
characterized in that the above described voice 
recognition means consists of voice data input means 
for inputting the digital voice data from the above 

10 described voice input means; operating unit information 
input means for inputting command information inputted 
from the above described operating means; dictionary- 
data accumulation means for associating the above 
described operating means unit information with the 

15 above described voice data and storing them in a 

storage medium such as a memory or a hard disk; pattern 
matching means for performing the pattern matching 
between the data from the above described voice data 
input means and voice dictionary data from the above 

20 described dictionary data accumulation means, and 

outputting a degree of similarity with respect to each 
command; driver information input means for inputting 
information on the registration of the above described 
dictionary information or a normal copy operation from 

25 the above described driver means; command processing 
means for receiving information from the above 
described pattern matching means and the information 
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from the above described command information input 
means, and in the case of the normal copy, determining 
which command the above described inputted voice 
command corresponds to, and transmitting the 
5 determination to command output means; and the command 
output means for transmitting the command information 
from the above described command processing means to 
the driver means or a mode display portion of the 
operation means in the case of the normal copy. 
10 [0013] 

(3) The voice command recognition and image 
processing apparatus according to any of the above 
items (1) and (2), characterized in that when the data 
is registered in the above described dictionary data 
15 accumulation means, the above described voice command 
recognition and image processing apparatus registers 
the above described voice data while actually 
performing an operation. 
[0014] 

20 (4) The voice command recognition and image 

processing apparatus according to any of the above 
items (1), (2) and (3), characterized in that when the 
above described voice data is registered, if the same 
data as data which has already been registered in the 

25 data in the above described dictionary data 

accumulation means has been attempted to be registered, 
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the above described voice command recognition and image 

processing apparatus informs a user of it. 

[0015] 

(5) The voice command recognition and image 

5 processing apparatus according to any of the above 
items (1) to (4) , characterized in that when the 
setting is performed by the above described voice, if a 
non-registered command has been attempted to be set by 
the above described voice, the above described voice 
10 command recognition and image processing apparatus 
informs the user that the command is non-registered. 
[0016] 

(6) The voice command recognition and image 
processing apparatus according to any of the above 

15 items (1) to (5), characterized in that when the 

setting is performed by the above described voice, if 
the command inputted by the voice has been similar to 
multiple commands, the above described voice command 
recognition and image processing apparatus informs 

2 0 those commands to prompt the user to select among them. 
[0017] 
[Operation] 

According to the above described configuration of 
the present invention, a new command input by the voice 
25 which has solved the above described problems can be 
performed. In other words: 
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1) When data to be referred to is registered in 
the dictionary data, the registration is performed by- 
registering it while actually depressing the button or 
the like at an operating unit so that an operation can 

5 be performed only by the voice when the same command is 
used next time. Thereby, it is not necessary for each 
user to previously spare time to register all commands, 
and also an individual using the machine can register 
only commands which are frequently used by the 
10 individual. Therefore, reduction in the capacity of 

the storage medium to be used for the dictionary can be 

realized. 

[0018] 

2) Moreover, also when the data registration is 
15 performed, the pattern matching is performed, and when 

the same command as the command which has already been 
registered has been inputted or if a similar command or 
a similar voice has been inputted, the user is informed 
of it by a display, a warning beep and the like. 
2 0 Thereby, it can be confirmed whether or not the command 
which has been attempted to be registered should be 
properly inputted. 
[0019] 

3) Moreover, when the user is recognized according 
25 to the voice, if there have been multiple data having a 

reasonably high degree of similarity in the registered 
dictionary data, the recognition is performed more 
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correctly according to another determination factor, 
for example, fingerprints, palm prints or the like. 
Thereby, the individual can be further correctly 
recognized rather than the recognition of the user only 
5 with the voice. 
[0020] 

[Embodiments of the Invention] 

Hereinafter, embodiments of the present invention 
will be described in detail based on multiple examples, 
10 with reference to the drawings, respectively. 
[0021] 
[Examples ] 

(First Example) 

A first specific example of an image processing 
15 apparatus according to the present invention will be 
described by using the case of a copying machine. 
Figure 1 shows a configuration block diagram of the 
copying machine of this first example (Figure 1 is used 
in common in second to fifth examples as described 
20 below) . 
[0022] 

Reference numeral 101 denotes an operating unit, 
of which a specific plan view example is shown in 
Figure 8, and which performs input of a command for a 
25 copy operation, a facsimile transmission or the like 
through each switch or button, a numeric keypad, a 
liquid crystal touch panel or the like, and the like. 
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Individual components in Figure 8 are described in 
annotations as shown respectively, and redundant 
descriptions thereof are omitted. 
[0023] 

5 Reference numeral 102 denotes a driver unit which 

uses a processing device such as a CPU, performs 
setting of image processing or setting of the number of 
sheets to be printed and the like according to the 
command from the operating unit 101, and controls 
10 operations in a scanner unit 103, an image processing 
unit 104, a printer unit 105 and the like. 
[0024] 

Reference numeral 103 denotes an image input unit 
which uses a CCD and the like, converts image data on a 
15 manuscript into digital data under the control of the 
driver unit 102, and outputs the digital data to the 
image processing unit 104. 
[0025] 

Reference numeral 104 denotes the image processing 
2 0 unit which processes the digital image data inputted 

from the image input unit 103, depending on the setting 
of the image processing from the driver unit 102, 
through a software-wise process and the like using a 
hardware circuit such as an ASIC, the CPU and the like, 
25 and performs output to the image output unit 105. 
[0026] 
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Reference numeral 105 denotes the image output 
unit which outputs the image data processed by the 
image processing unit 104 at a printer such as a laser 
printer or an ink jet printer, or outputs the image 
5 data to a CRT monitor, a liquid crystal monitor, the 
touch panel used by the operating unit 101 or the like. 
Moreover, this part also outputs the image data onto a 
network or performs the facsimile transmission via a 
modem . 
10 [0027] 

Reference numeral 106 denotes a voice input unit 
which inputs voice by using a microphone and the like, 
and transmits the voice as the digital data to a voice 
recognition unit. 

15 [0028] 

Reference numeral 107 denotes the voice 
recognition unit which inputs the voice data from the 
voice input unit 106, and performs registration in 
dictionary data, pattern matching of the voice, 

20 conversion into the command and the like. The 

converted command is transmitted to the driver unit 102, 
similarly to the command from the operating unit 101. 
[0029] 

Next, the voice recognition unit 107 which is 
25 characteristic of the present invention will be 
described in detail by using Figure 2 showing an 
internal process configuration block diagram thereof 
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(along with Figure 1, this figure is also used in 
common in the second to fifth examples as described 
below) . 
[0030] 

5 Reference numeral 201 denotes a voice data input 

unit which inputs the digital voice data from this 
voice input unit 201. 
[0031] 

Reference numeral 202 denotes an operating unit 
10 information input unit, which inputs command 

information inputted from the operating unit 101. 
[0032] 

Reference numeral 203 denotes a dictionary data 
accumulation unit which associates the operating unit 
15 information with the voice data and stores them in a 
storage medium such as a memory or a hard disk. 
[0033] 

Reference numeral 204 denotes a pattern matching 
unit which performs the pattern matching between the 
20 data from the voice data input unit 201 and voice 

dictionary data from the dictionary data accumulation 
unit 203, and outputs a degree of similarity with 
respect to each command. 
[0034] 

25 For example, when the inputted voice data has been 

"ichimai (one sheet)", the output is performed so that 
the degree of similarity to "ichimai" in the voice 
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dictionary data is 100, the degree of similarity to 
"hachimai (eight sheets)" is 80, the degree of 
similarity to "sanmai (three sheets)" is 30, the degree 
of similarity to "copy" is 5, and the like. 
5 [0035] 

Reference numeral 205 denotes a driver information 
input unit which inputs information on the registration 
of the dictionary information, a normal copy operation 
or the like, from the driver unit 102. 
10 [0036] 

Reference numeral 206 denotes a command processing 
unit which receives information from the pattern 
matching unit 204 and the information from the command 
information input unit 205, and in the case of the 

15 normal copy, determines which command an inputted voice 
command corresponds to, and transmits the determination 
to a command output unit 207. Moreover, when the 
dictionary information is registered, a process of 
transmitting some of commands having a high degree of 

2 0 similarity to the command output unit 207 or the like 
is performed. 
[0037] 

Reference numeral 207 denotes a command output 
unit which transmits the command information from the 
25 command processing unit 206 to the driver unit 102 or a 
mode display portion of the operating unit 101 in the 
case of the normal copy. Moreover, when the dictionary 
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information is registered, a similar command or a 
signal for generating a warning beep is transmitted to 
the operating unit 101. 
[0038] 

5 Next, process contents will be described with a 

specific example. When the voice command is registered, 
speaking is performed while a predetermined key is 
actually depressed. At this time, the voice data at 
that time is inputted from the voice data input unit 
10 201, and also information on the key depressed at that 
time is inputted from the operating unit information 
input unit 202 . 
[0039] 

For example, when "one black and white copy" is 
15 made, "copy" is spoken while a "COPY" key of Figure 8 
is depressed. Subsequently, a "copy" command is 
transmitted from the operating unit 101 to the driver 
unit 102, and also the command is similarly transmitted 
to the operating unit information input unit 2 02 in the 
20 voice recognition unit 107. 
[0040] 

Moreover, the voice data from the voice input unit 
106 is inputted to the voice data input unit 201, and 
inputted to the dictionary data accumulation unit 203 
25 along with the command information. In the dictionary 
data accumulation unit 203, the inputted voice data is 
stored corresponding to the "copy" command. 
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[0041] 

Subsequently, similarly, a "black and white" 
command and its voice data, as well as an "one" command 
and its voice data are registered and simultaneously 
5 settings thereof are performed. 
[0042] 

By speaking "start" while depressing a start key, 
a "start" voice command is registered and also a copy 
output can be performed. 
10 [0043] 

According to the above described operations, the 
voice commands such as "copy", "black and white", "one" 
and "start" are registered while the copy is actually 
performed. 
15 [0044] 

A flowchart of an operation sequence at the time 
of registering the voice command as described above 
corresponds to sequence solid line arrow portions of 
Figure 3. The voice input (step S301) is performed by 

20 the voice data input unit 201 of Figure 2, a status of 
the operating unit at that time is sensed by the 
operating unit status input unit 202, and it is 
determined whether or not the key input is 
simultaneously performed (step S302) . 

25 [0045] 

If the key input is simultaneously performed, a 
voice data registration mode is set (step S3 03) . The 
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pattern matching of the voice data is performed by the 
pattern matching unit 204 (step S3 04) , and if there is 
no similar command (step S305) , the inputted voice data 
is registered as a command in the dictionary data 
5 accumulation unit 203 (step S306) , and the command is 
executed (step S3 07). 
[0046] 

It should be noted that sequential detailed 
descriptions of respective steps shown by sequence 
10 dotted line arrows indicating NO in the above 

respective steps are as shown and redundant sequential 

detailed descriptions thereof are omitted. 

[0047] 

The command registered by the above described 
15 method can be used only by the voice without operating 
the key. 
[0048] 

In other words, if one copy in black and white is 
to be made, a "copy" mode is set if "copy" is spoken, 
2 0 and a "black and white" mode is set by speaking "black 
and white". Subsequently, an operation of the black 
and white copy can be performed by speaking "one" and 
"start" . 
[0049] 

25 A flowchart of an operation sequence at the time 

of executing the voice command at this time corresponds 
to sequence solid line arrow portions of Figure 4. The 
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voice input (step S401) is performed by the voice data 
input unit 2 01 of Figure 2, the status of the operating 
unit 101 at that time is sensed by the operating unit 
status input unit 202, and it is determined whether or 
5 not the key input is simultaneously performed (step 
S402) . 
[0050] 

If the key input is not simultaneously performed, 
a voice data execution mode is set (step S403) . The 

10 pattern matching of the voice data is performed by the 
pattern matching unit 204 (step S404) , and if there is 
only one command similar to the registered command 
(steps S405 and S406) , the inputted voice data is 
executed as the command (step S407) . 

15 [0051] 

Recognition of the voice command at this time will 
be described in detail. In the voice command 
recognition, the pattern matching between the voice 
data from the voice data input unit 2 01 of Figure 2 and 

20 the voice data stored in the dictionary data 

accumulation unit 203 is performed by the pattern 
matching unit 204, and the degree of similarity to each 
command is calculated and outputted to the command 
processing unit 206. In this case, if the voice data 

25 completely matches the registered dictionary data, the 
degree of similarity is set to 100. 
[0052] 
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For example, if the voice data "black and white" 
has been inputted, information showing that a degree of 
matching with "black and white" in the voice dictionary 
data in the dictionary data accumulation unit 203 is 95, 
5 the degree of matching with "copy" is 5, the degree of 
matching with "one" is 10, the degree of matching with 
"start" is 5 and the like is transmitted to the command 
processing unit 206. 
[0053] 

10 In the command processing unit 206, the data 

having a highest degree of matching is determined as 
the command inputted by the voice, and is transmitted 
to the command output unit 207. 
[0054] 

15 In the command output unit 207, setting of a 

machine body is performed by transmitting the command 

to the driver unit 102. 

[0055] 

According to a combination of the above described 
20 two operation flow diagrams of Figures 3 and 4, in the 
case of making one color copy next time, the "copy" 
mode is set if "copy" is spoken, a "color" mode is set 
by depressing a "COLOR" key while speaking "color", and 
also a "color" voice command is newly registered. 
25 [0056] 
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Subsequently, by speaking "one" and "start", the 
"color" voice command is newly registered and also an 
operation of the color copy can be performed. 
[0057] 

5 Since data on the voice command is inputted as 

described above, a necessary command can be registered 
when necessary and registration of a command which is 
not usually used is prevented, which can restrain the 
increase in capacity of the storage medium used by the 
10 dictionary data registration unit 203. 
[0058] 

It should be noted that sequential detailed 
descriptions of respective steps shown by respective 
sequence dotted line arrows in the respective steps of 

15 Figure 4 at the time of executing the voice command in 
this example are as shown and redundant sequential 
detailed descriptions thereof are omitted. 
[0059] 

(Second Example) 

20 The second example according to the present 

invention will be described by using Figures 1 and 2 
respectively in common. A process in the case where a 
command which has not been registered as the voice 
command has been inputted will be described as follows. 

25 [0060] 

First, the voice command is inputted in a state in 
which the key of Figure 8 at the operating unit 101 in 
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Figures 1 and 2 is not depressed, and thereby it can be 
determined that this is not the registration of a new 
voice command. 
[0061] 

5 Next, the pattern matching with the registered 

voice dictionary data is performed by the patter 
matching unit 204 in Figure 2, and the degree of 
similarity to each command is calculated and 
transmitted to the command processing unit 206. 
10 [0062] 

In this case, since the voice command is different 
from the registered command, all values of the degrees 
of similarity become low. In the case where the degree 
of similarity is set to 100 if they completely match 

15 each other, when the degree of similarity of more than 
or equal to 80 is determined as a command candidate and 
the degree of similarity of less than 80 is determined 
as a non-registered command input, the matching of all 
results in a state in which there is no registered 

20 command candidate. 
[0063] 

In such a case, it is determined that the voice 
data inputted by the command processing unit has not 
been registered, and information is transmitted from 
25 the command output unit 207 to the driver unit 102 to 
inform a user of it by displaying that "It is non- 
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registered. Depress a key to be registered. " on a 
liquid crystal display unit of the operating unit 101. 
[0064] 

The user confirms that it is non-registered, and 
5 subsequently, newly registers the command by depressing 
the key at the operating unit 101, and simultaneously 
the command is executed, and the process proceeds to 
the next process . 
[0065] 

10 A flowchart of an operation sequence at the time 

of registering the voice of this second example as 
described above corresponds to sequence solid line 
arrow portions of Figure 5. The voice input (step 
S501) is performed by the voice data input unit 201 of 

15 Figure 2, the status of the operating unit 101 at that 
time is sensed by the operating unit status input unit 
202, and it is determined whether or not the key input 
is simultaneously performed (step S502) . 
[0066] 

20 If the key input is not simultaneously performed, 

the voice data execution mode is set (step S503) . The 
pattern matching of the voice data is performed by the 
pattern matching unit 204 (step S504) , and if there is 
no similar command (step S506) , a display showing that 

25 the command is non-registered is performed as a message 
to the user by the operating unit 101 (step S506), and 
subsequently, the key which has been inputted is 
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registered as the voice command (step S507) . 
Concurrently, the command is executed (step S508) . 
[0067] 

Since the voice command data is inputted as 
5 described above, when the command which has not been 
registered as the voice command is inputted by the 
voice, the command can be easily registered as the new 
command . 
[0068] 

10 Sequential detailed descriptions of respective 

steps shown by respective sequence dotted line arrows 
in the respective steps of Figure 5 at the time of 
registering the voice command in this second example 
are as shown and redundant sequential detailed 

15 descriptions thereof are omitted. 
[0069] 

(Third Example) 

Next, the third example of the present invention 
will be described by using the above described Figures 

2 0 1 and 2 respectively in common. In the case of 

registering the voice command, an operation at the time 
when the command which has already been registered has 
been attempted to be further registered will be 
described. 

25 [0070] 

First, the voice command is inputted in a state in 
which the key at the operating unit 101 is depressed, 
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and thereby it is determined as the registration of the 

new voice command. 

[0071] 

Next, the pattern matching with the registered 
5 voice dictionary data is performed by the pattern 

matching unit 204, and the degree of similarity to each 
command is calculated and transmitted to the command 
processing unit 206. 
[0072] 

10 In this case, if the voice command is the command 

which has already been registered, there will be a 
command having a high value of the degree of similarity. 
[0073] 

In such a case, information is transmitted from 
15 the command output unit 207 to the driver unit 102 to 
prompt the user for confirmation by displaying the 
command having the high degree of similarity on the 
liquid crystal display unit (Figure 8) of the operating 
unit 101. 
20 [0074] 

As a specific example, though the "one" command 
has already been registered, if the command has been 
attempted to be registered again, the user speaks "one" 
while depressing the key (Figure 8) at the operating 
25 unit 101. 
[0075] 
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Similarly to the method described in the above 
described first example, when the pattern matching is 
performed by the voice recognition unit 107 and the 
degree of similarity is calculated, the degree of 
5 similarity of the "one" command becomes 90. If the 
degree of similarity of more than or equal to 80 is 
determined as the command candidate and the degree of 
similarity of less than 80 is determined as the non- 
registered command input, it is determined as the 
10 command which has already been registered. 
[0076] 

In such a case, a display of "Is the current 
command "one"?" and a display for selecting " YES" or 
"NO" are performed on the display unit of the liquid 
15 crystal touch panel (Figure 8), and thereby the user is 
informed that it is similar to the registered data. An 
example thereof is shown in Figure 9 . 
[0077] 

The user can confirm that it has already been 
20 registered, by depressing a "YES" key, and also the 
driver unit 102 accepts the inputted command and 
performs a subsequent process. In the case of "NO", 
the registration is performed again. 
[0078] 

25 A flowchart of the above described operation 

sequence corresponds to sequence solid line arrow 
portions of Figure 6. The voice input (step S601) is 
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performed by the voice data input unit 201, the status 
of the operating unit 101 at that time is sensed by the 
operating unit information input unit 202, and it is 
determined whether or not the key input is 
5 simultaneously performed (step S602) . 
[0079] 

If the key input is simultaneously performed, the 
voice data registration mode is set (step S603) . The 
pattern matching of the voice data is performed by the 

10 pattern matching unit 204 (step S604) , and if there is 
the similar command (step S605) , a display showing that 
the command has been registered is performed as the 
message to the user by the operating unit 101 (step 
S606), and subsequently, if the "YES" key is inputted 

15 (step S607), the command is executed (step S608) . 
[0080] 

Since the voice command data is processed as 
described above, when the command which has already 
been registered has been attempted to be further 
20 registered, duplicate registration can be prevented. 
[0081] 

It should be noted that sequential detailed 
descriptions of respective steps shown by sequence 
dotted line arrows in the respective steps of Figure 6 
25 at the time of registering the voice command in this 
third example are as shown and redundant sequential 
detailed descriptions thereof are omitted. 
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[0082] 

(Fourth example) 

Next, the fourth example according to the present 
invention will be described by using Figures 1 and 2 
5 respectively in common. In the case where the non- 
registered command has been attempted to be registered, 
an operation at the time when the voice data similar to 
the command which has already been registered has been 
inputted will be described. 
10 [0083] 

First, the voice command is inputted in the state 
in which the key at the operating unit 101 is depressed, 
and thereby it is determined as the registration of the 
new voice command. 
15 [0084] 

Next, the pattern matching with the registered 
voice dictionary data is performed by the pattern 
matching unit 204, and the degree of similarity to each 
command is calculated and transmitted to the command 
20 processing unit 206. 
[0085] 

In this case, if there has been the command having 
the high value of the degree of similarity among the 
commands which have already been registered, 
25 information is transmitted from the command output unit 
207 to the driver unit 102 to prompt the user for 
confirmation by displaying the command having the high 
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degree of similarity on the liquid crystal display unit 

(Figure 8) of the operating unit 101. 

[0086] 

As a specific example, if an "eight" command has 
5 been attempted to be newly registered, the user speaks 
"eight" while depressing the key (Figure 8) at the 
operating unit 101. However, it is assumed that, due 
to a way of speaking, the degree of similarity to the 
"one" voice command which has already been registered 
10 has also become high. 
[0087] 

Similarly to the method described in the above 
described first example, when the pattern matching is 
performed by the voice recognition unit 107 and the 
15 degree of similarity is calculated, the degree of 

similarity of the "one" command becomes 85. If the 
degree of similarity of more than or equal to 80 is 
determined as the command candidate and the degree of 
similarity of less than 80 is determined as the non- 
20 registered command input, it is determined as the 

degree of similarity at the same level as the command 
which has already been registered. 
[0088] 

In this case, subsequently, when the command input 
25 is attempted by the voice, mistakes are easily made in 
the recognition. 
[0089] 
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In such a case, a display of "The current command 
is similar to "one". Do you register it again?" and 
the display for selecting " YES" or "NO" are performed 
on the display unit of the liquid crystal touch panel 
5 (Figure 8) , and thereby the user is informed that it is 
similar to the registered data. An example thereof is 
shown in Figure 10. 
[0090] 

When the "YES" key is selected, the registration 
10 is performed again, and when a "NO" key is depressed, 
the voice command registration is directly performed 
and also the driver unit 102 accepts the inputted 
command and performs the subsequent process . 
[0091] 

15 A flowchart of the above described operation 

sequence can be similar to the solid line portions of 
Figure 6 in the above described third example. The 
voice input (step S601) is performed by the voice data 
input unit 2 01, the status of the operating unit 101 at 

20 that time is sensed by the operating unit status input 
unit 202, and it is determined whether or not the key 
input is simultaneously performed (step S602) . 
[0092] 

If the key input is simultaneously performed, the 
25 voice data registration mode is set (step S603) . The 
pattern matching of the voice data is performed by the 
pattern matching unit 204 (step S604) , and if there is 
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the similar command (step S605) , a display showing that 
the similar command has been registered is performed as 
the message to the user by the operating unit 101 (step 

5606) , and subsequently, the inputted key is registered 
5 as a command corresponding to the voice data (step 

5607) , and the command is executed (step S608) . 
[0093] 

Since the voice command data is processed as 
described above, even when the voice data to be newly 
10 registered has been similar to the command which has 
already been registered, the registration can be 
correctly performed. 
[0094] 

It should be noted that, also in this fourth 
15 example, with respect to details of respective steps 
shown by respective sequence dotted line arrows, 
redundant detailed descriptions thereof are omitted 
similarly to the above described third example. 
[0095] 

20 (Fifth example) 

Furthermore, the fifth example according to the 
present invention will be described by using Figures 1 
and 2 respectively in common. If the voice command 
recognition is performed, multiple similar command 

25 candidates may be listed with respect to the command 

inputted by the voice, and thereby an operation against 

- 35 - 



English translation of Japanese Patent Laid-Open No. 2000-029585 

the user's will may be performed. In order to prevent 
such a malfunction, the following process is performed. 
[0096] 

First, the voice command is inputted in the state 
5 in which the key at the operating unit 101 (Figures 2 
and 8) is not depressed, and thereby it is determined 
as the setting by the voice command. 
[0097] 

Next, the pattern matching with the registered 
10 voice dictionary data is performed by the pattern 
matching unit 204 (Figure 2), and the degree of 
similarity to each command is calculated and 
transmitted to the command processing unit 206. 
[0098] 

15 In this case, if the voice similar to a command to 

be actually set has been inputted, there will be 
multiple commands having the high value of the degree 
of similarity. 
[0099] 

20 In such a case, information is transmitted from 

the command output unit 207 to the driver unit 102 to 
prompt the user for selection by displaying the 
multiple commands having the high degree of similarity 
on the liquid crystal display unit of the operating 

25 unit 101. 
[0100] 
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As a specific example, the user hopes to set the 
"one" command and speaks "one". 
[0101] 

However, it is assumed that, due to pronunciation 
5 different from that of the registration or the like, 
the degree of similarity to the "eight" voice command 
has also become high. 
[0102] 

Similarly to the method described in the above 
10 described first example, when the pattern matching is 
performed by the voice recognition unit 107 and the 
degree of similarity is calculated, it is assumed that 
the degree of similarity of the "one" command becomes 
90 and the degree of similarity of the "eight" command 
15 becomes 85. If the degree of similarity of more than 
or equal to 80 is determined as the command candidate 
and the degree of similarity of less than 80 is 
determined as the non-registered command input, it is 
determined that both can be listed as the command 
20 candidate. 
[0103] 

In such a case, a display of "Which is the current 
command? 1: "one", 2: "eight"" is performed on the 
display unit of the liquid crystal touch panel to cause 
25 the user to select which command it is. The driver 
unit 102 performs the subsequent process with the 
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setting selected in this way as the inputted command. 
An example thereof is shown in Figure 11. 
[0104] 

A flowchart of the above described operation 
5 sequence becomes like operation sequence solid line 
arrow portions of Figure 7 (corresponds to a part of 
the dotted line arrow portions of Figure 6 in the above 
described third and fourth examples) . The voice input 
(step S701) is performed by the voice data input unit 

10 201 (Figure 2), the status of the operating unit 101 at 
that time is sensed by the operating unit status input 
unit 202, and it is determined whether or not the key 
input is simultaneously performed (step S702) . If the 
key input is not simultaneously performed, the voice 

15 day execution mode is set (step S7 03) . The pattern 

matching of the voice data is performed by the pattern 
matching unit 204 (step S704) , and if there are 
multiple similar commands (steps S705 and S706) , a 
display showing that the multiple similar commands have 

2 0 been registered is performed as the message to the user 
by the operating unit 101 (step S707), and subsequently, 
the command specified by the key input (step S708) is 
executed as an execution command (step S709) . 
[0105] 

25 Since the voice command data is processed as 

described above, even if the multiple commands having 
the high degree of similarity to the inputted voice 
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command have been registered, the setting can be 

correctly performed. 

[0106] 

[Advantages of the Invention] 
5 As described above, according to the present 

invention, in the image processing apparatus which 
performs the above described recognition of the command 
according to the voice and operates, when the data is 
registered in dictionary data accumulation means, the 

10 command for which the voice data is required to be 
registered while the operation is actually performed 
can be registered when necessary and the registration 
of the command which is not usually used is prevented, 
which can reduce the capacity of the storage medium 

15 used by the dictionary data accumulation means. 
[0107] 

Moreover, when the voice data is registered, if 
the same data as the data which has already been 
registered has been attempted to be registered in the 
20 data in the above described dictionary data 

accumulation means, it is displayed to the user and 
thereby the duplicate data registration can be 
prevented. 
[0108] 

25 Moreover, when the setting is performed by the 

voice, if the non-registered command has been attempted 
to be set by the voice, the display showing that the 
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command is non-registered is performed to the user and 
the registration can be performed in each case. 
[0109] 

Furthermore, when the setting is performed by the 
5 voice, if the command inputted by the voice has been 
similar to the multiple commands, those commands are 
displayed to prompt the user to select among them, and 
thereby the command can be correctly inputted. 
[Brief Description of the Drawings] 
10 [Figure 1] 

Figure 1 is a configuration block diagram of a 
copying machine of each example. 
[Figure 2] 

Figure 2 is an internal process configuration 
15 block diagram of a voice recognition unit of Figure 1. 
[Figure 3] 

Figure 3 is a flowchart of an operation sequence 
at the time of registering a voice command of a first 
example . 
20 [Figure 4] 

Figure 4 is a diagram showing a flowchart of an 
operation sequence at the time of executing the voice 
command of the first example. 
[Figure 5] 

25 Figure 5 is a flowchart of an operation sequence 

at the time of registering the voice command of a 
second example. 
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[Figure 6] 

Figure 6 is a flowchart of an operation sequence 
at the time of registering the voice command of third 
and fourth examples . 
5 [Figure 7] 

Figure 7 is a flowchart of an operation sequence 
at the time of registering the voice command of a fifth 
example . 
[Figure 8] 

10 Figure 8 is a plan view example of an operating 

unit of the copying machine of Figure 1. 
[Figure 9] 

Figure 9 is a display example of a liquid crystal 
touch panel on the operating unit of the third example. 
15 [Figure 10] 

Figure 10 is a display example of the liquid 
crystal touch panel on the operating unit of the fourth 
example . 
[Figure 11] 

20 Figure 11 is a display example of the liquid 

crystal touch panel on the operating unit of the fifth 
example . 

[Description of Symbols] 
101 Operating unit 
25 102 Driver unit 

103 Image input unit 

104 Image processing unit 
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105 Image output unit 

106 Voice input unit 

107 Voice recognition unit 

201 Voice data input unit 

202 Operating unit information input unit 

203 Dictionary data accumulation unit 

204 Pattern matching unit 

205 Driver information input unit 

206 Command processing unit 

207 Command output unit 
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[Figure 1] 

101 OPERATING UNIT 

102 DRIVER UNIT 

103 IMAGE INPUT UNIT 

5 104 IMAGE PROCESSING UNIT 

105 IMAGE OUTPUT UNIT 

106 VOICE INPUT UNIT 

107 VOICE RECOGNITION UNIT 

#1 OUTLINE CONFIGURATION BLOCK DIAGRAM OF COPYING 

10 MACHINE OF EACH EXAMPLE 

[Figure 2] 

101 OPERATING UNIT 

102 DRIVER UNIT 

15 106 VOICE INPUT UNIT 

107 VOICE RECOGNITION UNIT 

201 VOICE DATA INPUT UNIT 

202 OPERATING UNIT INFORMATION INPUT UNIT 

203 DICTIONARY DATA ACCUMULATION UNIT 
2 0 204 PATTERN MATCHING UNIT 
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25 VOICE RECOGNITION UNIT OF FIGURE 1 

[Figure 3] 
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S3 01 VOICE INPUT 

S3 02 IS KEY INPUT PERFORMED? 

53 03 VOICE DATA REGISTRATION MODE 

53 04 PATTERN MATCHING OF VOICE DATA 
5 S3 05 IS THERE NO SIMILAR COMMAND? 

S3 06 REGISTER VOICE DATA 

S3 07 EXECUTE COMMAND 

#1 FLOWCHART OF OPERATION SEQUENCE AT THE TIME OF 
REGISTERING VOICE COMMAND OF FIRST EXAMPLE 

10 #2 STEP 

#3 DISPLAY MESSAGE AT OPERATING UNIT 

#4 REGISTER VOICE COMMAND 

#5 EXECUTE COMMAND 

#6 VOICE DATA EXECUTION MODE 

15 #7 PATTERN MATCHING OF VOICE DATA 

#8 IS THERE ANY SIMILAR COMMAND? 

#9 ARE THERE MULTIPLE SIMILAR COMMANDS? 

#10 EXECUTE VOICE COMMAND 

#11 CONFIRM AND SELECT VOICE COMMAND 

20 

[Figure 4] 

5401 VOICE INPUT 

5402 IS KEY INPUT PERFORMED? 

5403 VOICE DATA EXECUTION MODE 

25 S404 PATTERN MATCHING OF VOICE DATA 

5405 IS THERE ANY SIMILAR COMMAND? 

5406 ARE THERE MULTIPLE SIMILAR COMMANDS? 
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S407 EXECUTE VOICE COMMAND 

#1 FLOWCHART OF OPERATION SEQUENCE AT THE TIME OF 

EXECUTING VOICE COMMAND OF FIRST EXAMPLE 

#2 STEP 

#3 VOICE DATA REGISTRATION MODE 

#4 PATTERN MATCHING OF VOICE DATA 

#5 IS THERE NO SIMILAR COMMAND? 

#6 REGISTER VOICE DATA 

#7 EXECUTE COMMAND 

#8 DISPLAY MESSAGE AT OPERATING UNIT 

#9 REGISTER VOICE COMMAND 

#10 EXECUTE COMMAND 

#11 CONFIRM AND SELECT VOICE COMMAND 

#12 EXECUTE VOICE COMMAND 

[Figure 5] 

5501 VOICE INPUT 

5502 IS KEY INPUT PERFORMED? 

5503 VOICE DATA EXECUTION MODE 

5504 PATTERN MATCHING OF VOICE DATA 

5505 IS THERE ANY SIMILAR COMMAND? 

5506 DISPLAY MESSAGE AT OPERATING UNIT 

5507 REGISTER VOICE COMMAND 

5508 EXECUTE COMMAND 

#1 FLOWCHART OF OPERATION SEQUENCE AT THE TIME OF 

REGISTERING VOICE COMMAND OF SECOND EXAMPLE 

#2 STEP 
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#3 VOICE DATA REGISTRATION MODE 

#4 PATTERN MATCHING OF VOICE DATA 

#5 IS THERE NO SIMILAR COMMAND? 

#6 REGISTER VOICE DATA 

5 #7 EXECUTE COMMAND 

#8 DISPLAY MESSAGE AT OPERATING UNIT 

#9 REGISTER VOICE COMMAND 

#10 ARE THERE MULTIPLE SIMILAR COMMANDS? 

#11 EXECUTE VOICE COMMAND 

10 #12 CONFIRM AND SELECT VOICE COMMAND 

[Figure 6] 

5601 VOICE INPUT 

5602 IS KEY INPUT PERFORMED? 

15 S603 VOICE DATA REGISTRATION MODE 

5604 PATTERN MATCHING OF VOICE DATA 

5605 IS THERE NO SIMILAR COMMAND? 

5606 DISPLAY MESSAGE AT OPERATING UNIT 

5607 CONFIRM AND REGISTER VOICE COMMAND 
2 0 S608 EXECUTE COMMAND 

#1 FLOWCHART OF OPERATION SEQUENCE AT THE TIME OF 
REGISTERING VOICE COMMAND OF THIRD AND FOURTH 
EXAMPLES 

#2 STEP 

25 #3 REGISTER VOICE DATA 

#4 EXECUTE COMMAND 

#5 VOICE DATA EXECUTION MODE 
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#6 PATTERN MATCHING OF VOICE DATA 

#7 IS THERE ANY SIMILAR COMMAND? 

#8 ARE THERE MULTIPLE SIMILAR COMMANDS? 

#9 EXECUTE VOICE COMMAND 

#10 DISPLAY MESSAGE AT OPERATING UNIT 

#11 CONFIRM AND SELECT VOICE COMMAND 

#12 REGISTER VOICE COMMAND 

[Figure 7] 

S7 01 VOICE INPUT 

S7 02 IS KEY INPUT PERFORMED? 

S7 03 VOICE DATA EXECUTION MODE 

5704 PATTERN MATCHING OF VOICE DATA 

5705 IS THERE ANY SIMILAR COMMAND? 

5706 ARE THERE MULTIPLE SIMILAR COMMANDS? 
S7 07 DISPLAY MESSAGE AT OPERATING UNIT 

S7 08 CONFIRM AND SELECT VOICE COMMAND 

S709 EXECUTE VOICE COMMAND 

#1 FLOWCHART OF OPERATION SEQUENCE AT THE TIME OF 

REGISTERING VOICE COMMAND OF FIFTH EXAMPLE 

#2 STEP 

#3 VOICE DATA REGISTRATION MODE 

#4 PATTERN MATCHING OF VOICE DATA 

#5 IS THERE NO SIMILAR COMMAND? 

#6 REGISTER VOICE DATA 

#7 EXECUTE COMMAND 

#8 DISPLAY MESSAGE AT OPERATING UNIT 
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#9 CONFIRM AND REGISTER VOICE COMMAND 
#10 EXECUTE VOICE COMMAND 
#11 REGISTER VOICE COMMAND 

5 [Figure 8] 

#1 PLAN VIEW EXAMPLE OF OPERATING UNIT OF COPYING 

MACHINE OF FIGURE 1 
#2 EXPANSION KEY 

DEPRESS IT WHEN FUNCTIONS OTHER THAN COPY AND FAX 
10 ARE OPERATED. 

#3 FAX KEY 

DEPRESS IT WHEN FAX FUNCTION IS USED. 
#4 COPY KEY 

DEPRESS IT WHEN COPY FUNCTION IS USED. 
15 #5 MAIN POWER LAMP 

IT LIGHTS WHEN MAIN POWER IS ON. 
#6 CLEAR KEY 

DEPRESS IT WHEN INPUTTED NUMBER OR CHARACTER IS 

DELETED . 

2 0 #7 OPERATING UNIT POWER SWITCH 

DEPRESS IT WHEN POWER OF OPERATING UNIT IS TURNED 
ON/OFF. WHEN IT IS OFF, THIS MACHINE IS PUT INTO 
SLEEP STATE. 
#8 COPY 
25 #9 FAX 

#10 EXPANSION 
#11 YOU CAN COPY. 
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#12 REDUCE 
#13 SAME SIZE 
#14 ENLARGE 
#15 SORTER 
5 #16 RESET 
#17 GUIDE 
#18 USER MODE 
#19 INTERRUPT 
#2 0 CLEAR 
10 #21 STOP 
#22 START 
#23 TOUCH PANEL 
#24 RESET KEY 
#25 GUIDE KEY 

15 DEPRESS IT WHEN GUIDE SCREEN IS DISPLAYED IN COPY 

FUNCTION OR FAX FUNCTION. 
#26 USER MODE KEY 

DEPRESS IT WHEN INITIAL SETTING OF THIS MACHINE 
IS CHANGED OR ADJUSTED. 
20 #27 INTERRUPT KEY 

#28 ONE-TOUCH DIAL BUTTONS 
#29 STOP KEY 
#3 0 START KEY 

DEPRESS IT WHEN MANUSCRIPT READING IS STARTED IN 
25 COPY FUNCTION OR FAX FUNCTION. 

#31 NUMERIC KEYPAD 

DEPRESS IT WHEN NUMERICAL VALUE IS INPUTTED. 
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[Figure 9] 

#1 DISPLAY EXAMPLE OF LIQUID CRYSTAL TOUCH PANEL ON 
OPERATING UNIT OF THIRD EXAMPLE 

5 #2 Is the current command "one"? 

#3 REDUCE 

#4 SAME SIZE 

#5 ENLARGE 

#6 SELECT PAPER 

10 #7 ZOOM 

#8 LIGHT COLOR 

#9 DEEP COLOR 

#10 SORTER 

#11 DOUBLE SIDE 

15 #12 CHARACTER 

#13 CHARACTER/ PHOTO 



[Figure 10] 

#1 DISPLAY EXAMPLE OF LIQUID CRYSTAL TOUCH PANEL ON 
20 OPERATING UNIT OF FOURTH EXAMPLE 

#2 The current command is similar to "one". Do you 
register it again? 

#3 REDUCE 

#4 SAME SIZE 
25 #5 ENLARGE 

#6 SELECT PAPER 

#7 ZOOM 
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#8 LIGHT COLOR 

#9 DEEP COLOR 

#10 SORTER 

#11 DOUBLE SIDE 

#12 CHARACTER 

#13 CHARACTER/ PHOTO 

[Figure 11] 

#1 DISPLAY EXAMPLE OF LIQUID CRYSTAL TOUCH PANEL ON 

OPERATING UNIT OF FIFTH EXAMPLE 

#2 Which is the current command? 

#3 ONE 

#4 EIGHT 

#5 REDUCE 

#6 SAME SIZE 

#7 ENLARGE 

#8 SELECT PAPER 

#9 ZOOM 

#10 LIGHT COLOR 

#11 DEEP COLOR 

#12 SORTER 

#13 DOUBLE SIDE 

#14 CHARACTER 

#15 CHARACTER/ PHOTO 



